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ABSTRACT 


The  optimal  minimum  time  control  is  applied  to  a  third 
order  regulator.  From  Pontryagin,  the  optimal  control  must 
minimize  the  Hamiltonian.  The  control  is  a  function  of  the 
states.  The  state  space  is  partitioned  into  regions  where  the 
optimal  control  is  either  plus  or  minus  N  (the  maximum  control 
magnitude)  which  is  bang-bang  control. 
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I.  INTRODUCTION 


In  recent  years,  much  attention  has  been  focused  upon 
optimizing  the  behavior  of  systems.  Some  particular  problems 
are  maximizing  the  range  of  a  rocket,  minimizing  the  error  in 
estimation  of  position  of  an  object,  and  minimizing  the  time 
required  to  reach  some  required  final  state.  To  solve  an 
optimization  problem,  we  must  first  define  a  goal  or  a 
performance  function  for  the  system  we  are  trying  to  optimize. 
Once  we  have  chosen  the  performance  function,  we  may  determine 
the  optimal  control  which  minimizes  (or  maximizes)  the 
performance  function. 

Optimization  has  some  disadvantages  besides  its  advantages. 
The  mathematical  formulation  of  the  design  requirement  is 
sometimes  not  that  easy.  For  high-order  systems,  especially, 
(n^2)  it  is  usually  difficult  to  determine  an  analytical 
expression  for  the  performance  function.  An  optimal  system  may 
be  very  sensitive  t^  wrong  starting  assumptions  and  a  system 
optimal  from  one  point  may  not  be  optimal  from  another  point. 

In  this  report,  we  will  develop  a  minimum-time  control  for 
a  third  order  regulator.  Our  objective  is  to  determine  a 
control  as  a  function  of  the  states  that  transfers  the  system 
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from  an  arbitrary  initial  state  to  a  specified  final  state 
(which  is  the  origin)  in  minimum  time. 
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II.  MINIMUM  TIME  CONTROL 


The  objective  in  optimal  control  problems  is  to  determine 
a  control  that  minimizes  the  performance  function. 

A.  PONTRYAGIN'S  PRINCIPLE 

The  principle  of  Pontryagin  is  of  considerable  importance 
in  the  theory  of  optimum  control  systems.  First,  let's 
formulate  Pontryagin 's  principle.  The  state  equations  of  a 
linear,  time-invariant,  controlled  system  of  order  n  having  m 
controls  are  given  as 

X  (  t)  =  Ax  {  t)  +Bu  (  t)  (2.1) 

y(t)  =  Cx(t)  *Du{t)  (2.2) 

where  A  and  B  are  constant  n*n  and  n*m  matrices,  respectively. 
The  control  vector  u(t)  is  required  to  be  piece-wise 
continuous  and  has  to  be  bounded. 

We  can  define  the  optimal  control  as  follows.  The  state 
of  the  system  is  defined  by  the  initial  condition  xit^)  at  the 
initial  time  t^.  The  system  is  to  be  transferred  to  the  final 
state  x(tf)  by  an  admissible  control  u(t),  where 

(2.3) 
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the  performance  of  the  system  is  minimum.  The  trajectory  x*(t) 
generated  by  the  optimal  control  is  called  the  optimal  state 
trajectory.  This  trajectory  is  the  solution  of  the  vector 
differential  equations  (2.1)  and  (2.2)  forced  by  the  optimal 
control,  u*(t).  The  system  is  time-invariant  and  x(tQ)  and 
x(t£)  are  fixed.  The  problem  is  the  optimal  control  of  a  time- 
invariant  system  with  fixed  boundary  points.  The  Hamiltonian 
is 

H{x(t)  ,  u(t)  ,p(t)  ,  t)  =  l+p^(t)  Ax-(t) +p’’(t)Bu(t)  (2.4) 

where  p(t)  is  the  Lagrange  multiplier. 

The  necessary  condition  for  u*(t)  to  minimize  the 
performance  function  J  is 

H(x*(t)  ,u*{t)  ,p*(t)  ,  t)  i  H(x*(t)  ,u(t)  ,p*{t)  ,t)  (2.5) 

or  in  other  words 

l+p*^Ax*(t) +p*^Su*(t)  5  l+p’’'{t)Ax*(t) +p*^(t)Bu(t)  (2.6) 

for  all  t  C  ^f  J  admissible  controls. 

The  equations  (2.5)  and  (2.6)  are  called  Pontryagin's 
minimum  principle.  The  necessary  conditions  for  u*(t)  to  be 
the  optimal  control  are 

x’(t)  =  |^(x*(t)  ,u*(t)  ,p*(t)  ,  t)  (2.7) 

dp 
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P^it)  =-^(x*(t),u*(t),p*(t),t)  (2.8) 

Hix*  (t)  ,u' (t)  ,p*  (t)  ,  t)  ^  H(x*(t)  ,u(t)  ,p*(t)  .  t)  (2.9) 
for  all  t  G  [t^,  t^]. 

B.  MINIMUM  TIME  SYSTEMS 

Here,  the  only  measure  of  performance  is  the  minimization 
of  the  transition  time  from  an  arbitrary  initial  state  to  the 
final  state.  Mathematically,  then,  our  problem  is  to  transfer 
a  system  given  by  the  equations  (2.1)  and  (2.2)  from  an 
arbitrary  initial  state  to  the  desired  final  state  and 
minimize  the  performance  function  that  is  described  by  the 
equation  (2.3). 

The  control  is  bounded 

(u^l  i  (2.10) 

The  scalar  control  variable  is  either  u=+N  or  u=-N,  and  the 
signs  alternate.  This  is  called  the  bang-bang  principle.  That 
is  the  optimal  control  switches  between  its  maximum  and 
minimum  admissible  values. 
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C.  OPTIMAL  CONTROL  OF  LINEAR,  TIME- INVARIANT  CONTROLLED 
SYSTEMS 

The  controlled  system  given  in  equations  (2.1)  and  (2.2)  is 
assumed  to  be  observable,  controllable.  The  time-invariant 
system  is  controllable  if  and  only  if  the  rank  r(Q)  of  the 
controllability  test  matrix 

Q=  [B  AB  .  .  .  A^-^B]  (2.11) 

is  equal  to  n,  the  order  of  the  system.  [Ref. 2] 

The  time-invariant  system  is  observable  if  and  only  if  the 
rank  r(R)  of  the  observability  test  matrix 

R=  [C^  .  .  (Ar)«-iC^]  (2.12) 

is  equal  to  n,  the  order  of  the  system.  [Ref. 2] 

In  equation  (2.4),  the  control  vector  u  occurs  only  in 
the  last  term  of  the  Hamiltonian  so  that,  only  this  term  is  to 
be  minim.ized 

B  u^(t)  (2.13) 

When  the  coefficient  of  u^(t)  is  positive,  u*j^(t)  must  be  the 
smallest  admissible  control  -N  and  when  the  coefficient  of 
u^(t)  is  negative,  u*j^(t)  must  be  the  biggest  admissible 
control  +N. 

u/(t)  = -N  sign  ip*"^  B)  (2.14) 
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This  equation  is  known  as  the  mathematical  statement  of  the 
bang-bang  principle. 

1.  Existence  Of  The  Minimum-Time  Control 

Finding  a  control,  if  one  exists,  that  transfers  the 
system  from  an  arbitrary  initial  state  x(tQ)  to  a  desired 
state  x(t£)=0  in  minimum  time,  is  called  the  linear  regulator, 
minimum-time  problem.  Before  trying  to  find  an  optimal 
control,  there  are  three  theorems  due  to  Pontryagin  that  we 
need  to  check. 

1.  If  all  of  the  eigenvalues  of  A  have  nonpositive 
real  parts,  then  an  optimal  control  exists. 

2.  If  an  extremal  control  exists,  then  it  is  unique. 

A  control  that  satisfies  the  conditions  in 

equations  (2.7),  (2.8),  and  (2.9)  is  an  extremal  control. 

3.  If  all  the  eigenvalues  of  A  are  real  and  an  unique 
time-optimal  control  exists,  then  each  control  component  can 
switch  at  most  (n-1)  times. 
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III.  SECOND  ORDER  CONTROLLER 


A.  MINIMUM  TIME  OPTIMAL  CONTROL 

When  we  specify  information  concerning  the  desired  states 
at  the  final  time  and  the  initial  condition  vector,  we  have  a 
two-point  boundary  value  problem  with  half  of  the  conditions 
specified  at  the  initial  time  and  the  other  half  specified  at 
the  final  time.  A  possible  method  of  solution  is  reversing 
time  in  the  equations;  starting  at  the  specified  final  vector 
which  is  often  the  origin  of  the  state  vector  with  a  constant 
control  until  a  switching  point  is  obtained.  [Ref.  2] 

1.  Problem  Definition 
Consider  the  system 

.  f  0  1 


u 


(3.1) 


where  u  is  the  control  variable  bounded:  I  u(t)l  <  N.  This  can 
be  represented  in  flow  diagram  as 


1  1 
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The  transfer  function  of  the  system  is 


X(s) 

U{s) 


=  G{s) 


1 

s (s+a) 


The  Hamiltonian  is 


H=1  +P1X2  -  ap2X2  +P2U 


(3.2) 


(3.3) 


From  Pontryagin  [Ref.l],  we  find  we  can  minimize  J  by 
minimizing  the  Hamiltonian.  This  is  achieved  with 

u  =  -N  sign(p2)  (3.4) 


where 


A 


(3.5) 


P2  ( t)  = --^  = -Pi  ( t) +ap2  ( t)  (3.6) 

so  that 

Pi(t)  =Pi(0)  (3.7) 

P2  ( t)  =  -Pi  (0)  t  +P2  (0)  e"*"'  +P2  (0)  (3.8) 


First,  we  need  to  check  the  controllabilty  and  observability 
of  the  system. 


0  = 


0 

1 


1 

-a 


and 


(3.9) 
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Both  matrices  have  a  rank  of  2,  so  that,  the  system  is 
controllable,  observable. 

Since,  the  eigenvalues  of  A,  0  and  -a,  are  nonpositive 
real  numbers,  an  optimal  control  exists,  and  this  extremal 
control  is  unique. 

Note  that,  from  the  theorems  due  to  Pontryagin,  the 
control  may  change  sign  only  once.  There  are  only  two  possible 
paths  for  the  states  to  take:  one  corresponding  to  u=+N  and 
one  corresponding  u=-N. 


Figure  3.1  Minimum  Time  Trajectory  Solution  Curves 
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B.  SOLUTION  TO  SECOND  ORDER  SWITCHING  CURVES 

We  will  solve  this  problem  for  arbitrary  initial 
conditions,  X2^(0)  and  X2(0).  But,  we  demand  that  the  final 
states,  x^(t£)  and  X2(t£),  will  be  zero. 

1.  Second  Order  Switching  Laws 

We  will  solve  the  problem  by  transforming  the  state 
equations  into  an  equivalent  uncoupled  system.  First,  we 
define  a  matrix  G  whose  columns  are  the  eigenvectors  of  A,  and 
define  a  new  dependent  variable  y  by 

X  =  Gy  (3.10) 


Then,  substituting  for  x  in  equation  (2.1),  we  obtain 

Gy  =  A  Gy  *  Bu  (3*11) 

By  multiplying  by  it  follows  that 

y  =  C'^AGy-*- G'^Bu  (3.12) 

After  a  little  algebra,  we  find 


1  ~1 

a  l' 

G  = 

a 

a 

and  G'^  = 

0  1, 

0 

1 

11 

-  _ 

a  1 

0  1 

a  1 

0 

a  a 

y* 

0  1 

0  1, 

0  -a 

.1. 

0  1  . 

(3.14) 
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u 


(3.15) 


y  = 


0  0 
0  -a 


y  + 


1 

1 


or  in  scalar  equations 


it)  =  u 

y2  (  t)  =  -ay2(t)  +  u 


(3.16) 

(3.17) 


The  forward  time  solutions  of  these  two  equations  are 


yi(t)  =yi(0)  +  ut 

y2(t)  =y2(0)  +  d-e-*"^) 

a 


(3.18) 

(3.19) 


2.  Negative  Time  System 

In  negative  time,  we  start  at  the  specified  final  state 
which  is  the  origin  with  a  constant  control  until  a  switching 
point  is  obtained.  In  negative  time  we  have 


y  = 


0  0 
0  a 


u 


or  in  scalar  equations 

yj  ( t)  =  -u 
y2(t)  =  ay^it)  -u 


(3.20) 


(3.21) 

(3.22) 


The  solutions  of  these  two  first  order  differential  equations 
are 
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y^it)  =  y^(o)  -  ut  (3.23) 

y2(t)  =  y2(0)e“"  +  -H  (i-e“‘)  (3.24) 

a 

By  putting  u=+N  in  the  negative  time  equations  we  have 

yi(t)  =  yi(0) -Wt  (3.25) 

y2(t)  =y2(0)e“‘^  +  ^(l-e“^)  (3.26) 

a 

And  with  u=-N  we  get 

Viit)  =  +Nt  (3.27) 

y2(t)  =y2(0)e“‘=--^(l-e“t)  (3.28) 


Since,  we  are  going  in  negative  time,  the  starting  point  is 
the  origin,  so  that  y2(0)®0  and  y2(0)=0*  So,  in  negative  time 
from  the  origin  for  u=+N,  we  have 

y^it)  =  -Nt  (3.29) 

y2(t)  =  ^(l-e»t)  (3.30) 

a 

For  u=-N  we  have 

y^it)  =  Nt  (3.31) 

y2(t)  = -^(l-e«')  (3.32) 

Cl 

By  eliminating  t  from  equations  (3.30)  and  (3.32)  and 
substituting  these  into  equations  (3.29)  and  (3.31)  and  by 
taking  care  of  the  sign  changes  due  to  +N  or  -N,  we  get 
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u  =  -N sign sign  (y^)  ^  lnjl  +  -^|y2|J|  (3.33) 


The  second  order  switching  curve  of  equation  (3.33)  is 
simulated  in  Figure  3.2. 
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A  simulation  of  this  switching  law  is  given  in  Figure  3.3. 


Second  Oidez  Switching  Curve 


Figure  3.3  The  Second  Order  Switching  Curve 

We  drive  the  states  from  an  arbitrary  initial  condition  to  the 
origin  with  this  switching  law  with,  at  most,  one  change  of 
the  control  effort. 

3.  Simulation  of  the  Second  Order  Control  in  Uncoupled 
Space 

We  need  to  test  the  accuracy  of  the  solutions  by  using 
a  computer  solution.  To  test  the  switching  law  of  equation 
(3.33),  we  simulate  the  system  in  uncoupled  space  using  a 
maximum  control  effort  of  N=1  and  a=l.  The  output  of  the 
simulation  is  shown  in  Figure  3.4.  As  we  can  see  from  this 
figure,  the  control  effort  which  is  given  in  Figure  3.5, 
drives  the  states  first  to  the  zero  trajectory  curve,  then  to 
the  origin.  After  that,  in  order  to  demonstrate  the  effects  of 
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N  and  a,  we  run  the  simulation  first  with  a  maximum  control 
effort  of  N=5.  The  results  of  this  simulation  are  given  in 
Figures  3.6  and  3.7.  The  effect  of  a  dre  presented  in  Figures 
3 . 8  and  3.9. 

As  we  can  see  from  these  figures,  increasing  the 
magnitude  of  the  control  effort  shortens  the  response  time  of 
the  system.  A  bigger  time  constant,  a,  slows  down  the  response 
of  the  system. 

4.  Simulation  of  the  Second  Order  Control 

Now,  we  can  simulate  the  system  of  equation  (3.1)  in 
normal  two-dimensional  space  whose  switching  law  is  given  by 
equation  (3.37).  The  same  control  effort,  time  constant  and 
initial  conditions  which  are  used  to  simulate  the  system  in 
uncoupled  space  are  used  here  again.  First,  simulation  is  with 
a  maximum  control  effort  of  N=1  and  a  time  constant  of  a=l. 
The  results  of  this  simulation  are  given  in  Figures  3.10  and 
3.11.  The  second  simulation  is  with  a  maximum  control  effort 
of  N=5  whose  results  are  given  in  Figures  3.12  and  3.13.  The 
last  simulation  is  with  a  time  constant  of  a=5  to  show  uhe 
effect  of  the  time  constant  in  the  system.  Results  of  this 
simulation  are  given  in  Figures  3.14  and  3.15.  Again,  bigger 
control  effort  shortens  the  response  time  of  the  system  and 
bigger  time  constant  slows  down  the  response  of  the  system. 
After  these  simulations,  in  order  to  test  that  the  switching 
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laws  work  for  an  arbitrary  initial  condition,  the  system  is 
simulated  with  initial  conditions  X2(0)=-l,  X2(0)=-l,  whose 
results  are  given  in  Figures  3.16  and  3.17,  and  x^CO)*-!, 
X2(0)=l,  whose  results  are  given  in  Figures  3.18  and  3.19. 
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Figure  3.4  Simulation  of  Second  Order  Controller 


Figure  3.5  Control  Effort  for  Second  Order  Controller 
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Figure  3.6  Simulation  of  Second  Order  Controller 


Second  Order  Control 


Figure  3.7  Control  Effort  for  Second  Order  Controller 
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Figure  3.12  Simulation  of  Second  Order  Controller 


Second  Order  Control 


Figure  3.13  Control  Effort  for  Second  Order  Controller 
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Figure  3.14  Simulation  of  Second  Order  Controller 


Second  Order  Control 


Figure  3.15  Control  Effort  for  Second  Order  Controller 
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Tune  (  second  ) 

Figure  3.17  Control  Effort  for  Second  Order  Controller 
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Figure  3.18  Simulation  of  Second  Order  Controller 
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IV.  THIRD  ORDER  CONTROLLER 


In  the  previous  chapter,  we  found  the  relations  between  the 
states  in  two-dimensional  space.  Now,  we  need  to  combine  these 
relations  in  three-dimensional  space  in  order  to  find  the 
third  order  switching  law. 

A.  FORWARD  TIME  STSTEM 

A  third  order  minimum  time  controller  can  be  used  in  a 
point  defense  system  to  position  the  missile  in  minimum  time 
onto  a  "head-on"  collision  course  with  the  target  where  the 
approaching  missile  is  in  its  final  trajectory  and  not 
maneuvering. 

1 .  System  Definition 

Our  third  order  linear  system  is 

o' 

0  u  (4*1) 

1. 

This  can  be  represented  in  flow  diagram  as  follows 

1  11 


-« 


0  10 
001  x+ 
0  0  -o 
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The  transfer  function  of  the  system  is 


=  G(s)  = - - - 

U{s)  (s+a) 


(4.2) 


Again,  as  the  first  step,  we  need  to  check  the 
controllability  and  observability  of  the  system. 


0  0  11  [  1  0  0 ' 

Q=  0  1  -a  and  J?  =  0  1  0  (4.3) 

.1  -a  J  [o  0  1. 


Both  matrices  have  a  rank  of  3  so  that  the  system  is 
controllable,  observable.  The  eigenvalues  of  A,  0,  0  and  -a, 
are  all  nonpositive  real,  so  an  optimal  control  exists. 

From  the  theorems  due  to  Pontryagin,  the  control  may 
change  sign,  at  most,  twice.  Again  going  back  in  negative 
time,  we  may  follow  the  zero  trajectory  curves  out  from  the 
origin  with  control  efforts  of  +N.  Now,  an  infinite  number  of 
curves  intersect  these  zero  trajectory  curves  by  making  a 
surface.  And,  from  this  surface,  an  infinite  number  of 
trajectories  take  us  to  the  initial  conditions.  So,  we  start 
with  an  arbitrary  initial  condition  such  that  u=+N  will  drive 
the  system  to  intersect  with  the  surface  as  shown  in  Figure 
4.1.  On  this  surface,  the  control  will  switch  to  u=-N  and 
drive  the  system  along  the  surface  to  intersect  with  the  zero 
trajectory  curve.  Here,  the  control  will  switch  to  u=+N  again 
and  will  drive  the  system  to  the  origin. 
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Figure  4.1  Three-Dimensional  Switching  Curves 

2.  Third  Order  Switching  Curves 

Starting  with  the  state  equation  (4.1)  and  transforming 
this  into  the  uncoupled  system  by  equation  (3.8)  we  get 

a  1  0 

and  =  0  a  1  (4.4) 

0  0  1, 


0  10  0 

j>^=000y+lu  (4.5) 

0  0  -a  1 


or  in  scalar  equations 


yi(t)  =72(0) 

(4.6) 

3^2(0  =  u(c) 

(4.7) 

3/3(0  =  -03/3(0)  +u(0 

(4.8) 

The  Hamiltonian  is 

H=  1  +P3y2 -Pjttya  +  (P2  +P3 )  u 

(4.9) 

From  Pontryagin  [Ref.l]  we  can  minimize  J 

by  minimizing  the 

Hamiltonian.  This  is  achieved  with 

u  =  -N  sign  (p2+p^) 

(4.10) 

where 

A  / 

(4.11) 

A  ( ~  872"  ^ 

(4.12) 

P3(0  =  =  ap^it) 

dyj 

(4.13) 

so  that 

P3(0  =Pi(0) 

(4.14) 

P2(t)  =P2(0)  -Pi(0)  t 

(4.15) 

P3  ( t)  =  P3  (0)  e**" 

(4.16) 

The  solution  of  state  equation  (4.5)  is 
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(4.17) 


yi(t)  =yi(0)  +y2(0)  t*^ut^ 


72  (t)  =  yjCO)  +  ut 
y3(t)  =y3(0)  + 


When  we  discretize  the  equations 


4*  =  S£'^((sI-A)-^)  =9!'^ 


-  A  0 

s 


0-0 

s 


0  0 


S+O 


1  t  0 
0  1  0 
0  0  e'“^ 


A  =  /*  ‘'<|)Bdt  =  f  ' 
Jo  Jo 


1 

t 

t  ■ 

2^ 

1 

dt  = 

t 

= 

t 

a 

0 

A  (l-e-«‘) 

a 

Combining  these  we  obtain 


y(t)  = 


1 

t 

0  ■ 

0 

1 

0 

0 

0  0-“*^ 

y(0)  + 


—  (1-0-“^) 

a 


u{0) 


or  in  scalar  equations 


yi(t)  *yi(0)  +y2(0)  t  +  -|u(o) 


yjCt)  =  y2(0)  +u(0)  t 


y,(t)  =y3(o)e-«‘^  +  i^(l-e-«^) 


(4.18) 

(4.19) 

(4.20) 

(^•21) 

(4.22) 

(4.23) 

(4.24) 

(4.25) 
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B.  NEGATIVE  TIME  SYSTEM 

In  negative  time,  we  start  at  the  origin  with  a  control 
until  a  switching  point  is  determined  to  determine  the  other 
half  of  the  boundary  conditions.  In  negative  time  we  have 


^0  -1 

0  ■ 

0 

y  = 

0 

0 

0 

y* 

-1 

0 

0 

a 

-1. 

(4.26) 


(4.27) 


(4.28) 


(4.29) 


(4.30) 


31 


y2^t)  =  y2(Q)  -u(o)  t 

(4.31) 

y3(t)  =  yj  (0)  (l-e*'") 

a 

(4.32) 

1.  Solving  For  Negative  Time  Boundary  Points 

Since  we  are  going  back  in  negative  time  starting  from 
the  origin,  yi(0)=0,  y2(0)=0  and  y3(0)=0,  we  have 

yi(t)  =  -|u(0) 

(4.33) 

yj  ( t)  =  -u(0)  t 

y  (t)  =  (1-6““^) 

a 

(4.34^ 

(4.35) 

Setting  u=+N  and  travelling  back  along 

trajectory  curve  for  1  second,  we  find 

the  zero 

y^d)  = 

(4.36) 

y^ii)  *  -N 

(4.37) 

yjd)  =  -d-e«) 

a 

(4.38) 

Similarly,  we  run  the  system  in  negative  time  for  2  and 
3  seconds  to  obtain  other  boundary  points  as  shown  in  Figure 
in  4.2,  and  listed  in  Table  1. 
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TABLE  1 


NEGATIVE  TIME  BOUNDARY  CONDITIONS 


Figure  4.2  Boundary  Values  in  Negative  Time  Solution 
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The  control  effort  may  also  be  u=-N.  The  boundary 
conditions  in  negative  time  along  the  zero  trajectory  curve 
with  u=-N  are  listed  in  Table  2. 


TABLE  2 

NEGATIVE  TIME  BOUNDARY  CONDITIONS 


u=-N 

t=i 

t=2 

t=3 

yi(t) 

1 

toll-* 

-2N 

-1" 

y2(t) 

N 

2N 

3N 

y3(t) 

(i-e“) 

a 

a 

a 

We  may  now  solve  for  the  family  of  curves  that  intersect 
the  zero  trajectory  curves.  Specifically,  we  solve  for  the 
equation  of  the  curve  that  travels  from  some  point  yj^(O), 
y2(®)/y3(®)'  point  at  1  second  with  the  positions  of 

the  states  given  in  Table  1.  Since  the  control  effort  on  the 
zero  trajectory  for  this  intersection  point  is  u=+N,  the 
control  effort  for  the  curve  we  are  solving  for  must  be  u=-N. 
And  the  forward  time  equations  must  be  equal  to  the  negative 
time  equations,  so  we  may  write 

y^{t)  =  lN=yj_{0)  +yj(0)  (4.39) 

y^it)  = -N=  y^iO) -Nt  (4.40) 

y  (t)  =  i?(i-e*)  =  y3(0)  e-‘^-^(l-e-“^)  (4.41) 

^  a  ^  a 
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Solving  equation  (4.40)  for  t  we  find 


t  = 


1  + 


y2(0) 

N 


(4.42) 


Substituting  equation  (4.42)  into  equations  (4.39)  and  (4.41) 
we  get 


iV=yi(0) 


.  y|(o) 

2N 


(4.43) 


0  =  e-«e  *  "  (y->(0) +— +  — e“  (4.44) 

\  •*  aj  a  a 

We  may  generate  a  family  of  equations  representing  both 
sides  of  the  zero  trajectory  curves,  and  different  points  of 
intersection  along  the  curves  which  are  listed  in  Table  3.  The 
control  effort,  u,  in  Table  3,  is  the  control  effort  for  the 
zero  trajectory  that  is  intercepted.  The  time,  t  is  the  time 
out  from  the  origin  to  the  intercept  time  for  the  negative 
system. 

To  combine  all  the  equations  from  Table  3  into  one 
solution  we  define 


and 


w= 


yi<0)  + 


yzCo)  |y2(0) 

2N 


f  ~  yi(o)  +w 


y|(o) 

2N 


(4.45) 

(4.46) 


z  = 


(4.47) 
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TABLE  3 

FAMILY  OF  SOLUTION  CURVES 


u=+N 

t=l 

N  =  yj^(0)  + 

^  2N 

0  =  e-e'*  '» 

\  a }  a  a 

u=+N 

t=2 

iN- yi(0)  + 

^  2N 

_  Xj(0) 

0  =  e"^*e  ^  (y,  (0)  +  —  1  + —  e^* 

\  ^  a }  a  a 

u=+N 

t=3 

y2(o) 

0=e‘^*e*  "  (y  (0) +  — — — e^® 

\  a  1  a  a 

■ 

0  =  e'*e*  (yjCO) -  — \  +  -^-  — e® 

■ 

0  =  e‘2®e*  (yj  (0) -  — \  +  — -  — e^® 

\  ^  o  /  a  a 

■ 

y2(o) 

0=e'3®e*  "  (y  (0) -  —  )  +  — e3“ 

\  ^  0/0  o 
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so  that  our  family  of  curves  is  defined  as 

0  =  (e-“  (0)  (4.48) 

Equation  (4.45)  tells  us  which  sign  to  apply  depending  on  the 
direction  of  the  zero  trajectory  curve.  Equation  (4.47)  gives 
the  magnitudes  of  the  equation  depending  on  the  distance  of 
the  zero  trajectory  curve  from  the  origin. 

C.  THIRD  ORDER  SWITCHING  LAW 

Using  equations  (4.45),  (4.46),  (4.47),  and  (4.48)  we  can 
obtain  the  third  order  switching  law.  So,  our  third  order 
switching  law  in  the  uncoupled  space  can  be  defined  as 

(4.49) 


f=y^(0).w 

(4.50) 

^=\P 

(4.51) 

N 1  -^^1 

'  Tl 

u  = -N sign  e  ^ 

(4.52) 

We  can  now  go  back  to  our  normal  state  space  by  using  equation 
(3.11)  so  that 

yi=aXi+X2  (4.53) 
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y2  =  ax2*x^ 
Vz  =  x^ 


(4.54) 

(4.55) 


Therefore,  the  third  order  switching  law  is  defined  as 
w=S2gnlaXi  (0) +^2  (0)  + - = - 2 - _i — ? - 1 - LI  (4.56) 


f=ax^  (0)  +X2  (0)  + 


4 

_  ~~f 
‘N  N 


(0X2(0)  +X3(0)  )2 


2N 


) 


(4.57) 


(4.58) 


So  finally,  the  switching  law  containing  the  coupled  state 
values  is: 


u  =  -Nsigiie'^'^  e 


(axa(o)  ♦jr3(0) ) 

"  (X3(0) 


«  )j 


(4.59) 


D.  THIRD  ORDER  CONTROLLER  SIMULATION 
1.  Simulation  in  Uncoupled  Space 

A  simulation  of  this  regulator  shows  that  the  third 
order  switching  law  of  equation  (4.49),  drives  the  states 
first  to  the  zero  trajectory  curve  and  then  to  the  origin  with 
2  changes  in  the  control  effort.  The  first  run  is  from  the 
initial  point  of  Xj^(0)=-l/2,  X2(0)=0,  X3(0)=0  with  a  maximum 
control  effort  of  N=1  and  a  time  constant  of  a=l.  The  results 
of  this  run  are  given  in  Figures  4.3  and  4.4.  In  order  to  show 


38 


the  effects  of  maximum  control  effect,  N  and  the  time 
constant,  a,  two  other  simulations  are  run.  The  results  of 
these  simulation  are  given  in  Figures  4.5,  4.6  and  4.7,  4.8. 

2.  Simulation  of  Minimum  Time  Control  of  the  Third  Order 

Regulator 

Now,  we  need  to  simulate  the  regulator  in  3  dimensional 
space.  Again,  a  simulation  of  the  third  order  regulator  shows 
that  the  third  order  switching  law  of  equation  (4.56)  drives 
the  states  to  the  origin  with  only  2  changes  in  the  control 
effort.  The  results  of  this  run,  again  with  initial  conditions 
of  Xj^(0)=-l/2,  X2(0)=0,  X3(0)=0,  a  maximum  control  effort  of 
N=1  and  a  time  constant  of  a=l,  are  given  in  Figures  4.9  and 
4.10.  With  the  same  initial  conditions  in  order  to  show  the 
effects  of  N  and  a,  we  run  the  system  two  more  times.  The 
results  of  the  simulation  with  a  control  effort  of  N“5,  and  a 
time  constant  of  a=l  are  given  in  Figures  4.11  and  4.12.  The 
results  of  the  simulation  with  a  control  effort  of  N=1  and  a 
time  constant  of  a=5  are  given  in  Figures  4.13  and  4.14.  Our 
switching  law  should  work  from  an  arbitrary  initial  condition. 
So,  in  order  to  test  the  switching  law,  we  simulated  the 
system  from  three  different  initial  conditions.  The  first  one 
is  from  the  initial  point  of  Xj=-l/2,  X2=l,  *3=1  whose  results 
are  given  in  Figures  4.15  and  4.16.  The  second  simulation  is 
from  Xj^=0,  X2=-1/2,  X3=0  whose  results  are  given  in  Figures 
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4.17  and  4.18.  And  the  last  simulation  is  from  the  same 
initial  point  of  X]^=0,  X2=-l/2,  X3=0,  with  a  maximum  control 
effort  of  N=5  whose  results  are  given  in  Figures  (4.19)  and 
4.20. 
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Figure  4.3  Simulation  of  Third  Order  Controller 


Figure  4.4  Control  Effort  for  Third  Order  Controller 
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Figure  4.7  Simulation  of  Third  Order  Controller 


Third  Order  Control 


•  B  3  «  19 


Time  (  second  ) 

Figure  4.8  Control  Effort  for  Third  Order  Controller 
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Third  Older  Switching  Law 


Time  (  second  ) 

Figure  4.10  Control  Effort:  for  Third  Order  Control 
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Third  Order  Switching  Law 
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Third  Order  Switching  Law 


Time  (  second  ) 

Figure  4.14  Control  Effort  for  Third  Order  Controller 


46 


Figure  4.15  Simulation  of  Third  Order  Controller 


0  1  I  I  4  5  I 


Time  (  second  ) 

Figure  4.16  Control  Effort  for  Third  Order  Controller 
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Figure  4.19  Simulation  of  Third  Order  Controller 


Tine  (  second  ) 


Figure  4.20  Control  Effort  for  Third  Order  Controller 
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V.  CONCLUSION 


We  have  developed  a  minimum  time  controller  that  drives  the 
states  to  the  origin  for  a  third  order  regulator.  Our 
controller  has  a  maximum  control  effort,  N,  and  a  time 
constant,  a,  so  that  both  can  be  adjusted  according  to  need. 

As  we  can  see  from  the  simulations,  when  we  increase  the 
magnitude  of  the  control  effort,  the  response  of  the  system  is 
faster.  The  effect  of  the  time  constant  is  in  the  reverse 
direction.  When  we  increase  the  magnitude  of  the  time 
constant,  the  response  of  the  system  decreases. 

After  driving  the  states  to  the  origin,  the  switching  law 
may  be  confused  at  the  origin,  so  chatter  may  occur.  In  order 
to  prevent  this,  we  may  need  to  turn  off  the  control  effort 
upon  reaching  the  origin.  Increasing  the  sampling  rate  may 
decrease  the  magnitude  of  the  chatter. 

Our  third  order  switching  law  can  be  applied  to  a  fast 
reaction  defense  missile  where  the  approaching  missile  has  a 
speed  advantage  and  the  standard  proportional  navigation 
controller  may  not  catch  the  approaching  missile. 
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APPENDIX.  PROGRAM  CODE 


1.  BB2MDUM.M 

%  BB2NDUN.M  11  October  1991 

%  This  program  is  a  simulation  of  the  minimum  time  control  of 
%  the  second  order  system  in  forward  time  in  uncoupled  space. 
%  written  by  Kayhan  Vardareri 
clg; clear 
alpha  =1; 

N  =1;  %  The  magnitude  of  the  control  effort 

A  =[0  0;0  -alpha];  %  State  matrices  of  the  system 

B  =[i;i]; 

C  =[1  0]; 

Tf  =4.5;  %  Length  of  simulation 

dt  =0.01;  %  Time  increment  for  simulation 

[phi, del]  =c2d(A,B,dt) ;  %  Discretize  the  system 

kmax  =Tf/dt+l;  %  Maximum  integer  value  for  the  simulation 

y  =zeros(2,kmax) ;  %  Storage  vectors 

d  =zeros( l,kmax) ; 

u  =zeros(l,kmax); 

time  =zeros ( 1 , kmax ) ; 

ylO  =2;  %  Initial  conditions  for  y 

y20  =1; 
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y(*/l)  =[yl0;y20];  %  Initial  state  vector 

%  Begin  Simulation 
for  (i=l:kmax-l); 

u(l,i)=-N*sign(y(l,i)-sign(y(2,i) ) *N/alpha*log( . . . 

l+alpha/N*abs(y(2,i) ) ) ); 
y(:,i+l)  =phi*y( : , i)+del*u(i) ; 
d  =C*y( :,i+l); 
time(i+l)  =time(i)+dt; 
end 

%  Plots  of  The  Outputs 
plot(y(l, ; ),y(2, : ) );grid; 
xlabel( 'Yl' );ylabel( 'Y2' ) ; 

title ( 'Second  Order  Switching  Law  (Uncoupled  Space)'); 
gtext( [ 'N=' ,num2str(N) ]) ;gtext( [ 'alpha  =  ' ,num2str(alpha) ] ) ; 
%meta  kay2us 
pause; clg; 
plot ( time, u) 

xlabel( 'Time  (sec) ' ) ;ylabel( 'Magnitude' ) ; 
title ( 'Second  Order  Control'); 

%meta  kay2uc 
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2.  BB2ND.M 


%  BB2ND.M  11  October  1991 

%  This  program  is  a  simulation  of  the  minimum  time  control  of 
%  the  second  order  system  in  forward  time. 

%  written  by  Kayhan  Vardareri 
clg; clear 
alpha  =1; 

N  =1;  %  The  magnitude  of  the  control  effort 

A  =[0  1;0  -alpha];  %  State  matrices  of  the  system 

B  =[0;1]; 

C  =[1  0]; 

Tf  =4.5;  %  Length  of  simulation 

dt  =0.01  %  Time  increment  for  simulation 

[phi, del]  =c2d(A,B,dt ) ;  %  Discretize  the  system 

kmax  =Tf/dt+l;  %  Maximum  integer  value  for  the  simulation 

X  =zeros(2,kmax) ;  %  Storage  vectors 

y  =2eros( l,kraax) ; 

u  =zeros( l,kmax) ; 

time  =zeros(l,kmax) ; 

xlO  =1;  %  Initial  conditions  for  x 

x20  =1; 

x(:,l)  =[xl0;x20];  %  Initial  state  vector 

%  Begin  Simulation 
for  (i=l ;kmax-l ) ; 
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u(i)='N*sign(alpha*x(l,i)+x(2,i)-sign(x(2/i) ) . . . 

*(N/alpha*log( l+alpha/N*abs(x(2, i) ) ) ) ) ; 
x(:,i+l)  =phi*x( ; / i)+del*u(i) ; 
y  =C*x(:,i+l); 
tiine(i+l)  =tiine(i)+dt; 
end 

%  Plots  of  The  Outputs 

plot(x(l, : ) ,x(2, : ));grid; 

xlabel( 'XI' );ylabel( 'X2' ); 

title (' Second  Order  Switching  Law'); 

gtext(['N=  num2str(N) ]) ;gtext( [ 'alpha =  ', num2str (alpha) ]) ; 
%meta  kay2s 
pause; clg; 
plot ( time, u) 

xlabel( 'Time  (sec) ' ) ;ylabel( 'Magnitude' ) ; 
title (' Second  Order  Control'); 

%meta  kay2c 
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3.  BB3RDUN.M 


%  BB3RDUN.M  11  October  1991 

%  This  program  is  the  simulation  of  the  minimum  time  control 
%  of  the  third  order  regulator  in  uncoupled  space. 

%  written  by  Kayhan  Vardareri 
clg; clear 
alpha  =1; 

N  =1;  %  The  magnitude  of  the  control  effort 

A  =[0  1  0;0  0  0;0  0  -alpha];  %  State  matrices  of  the  system 
B  =[0;l;l]; 

C  =[1  0  0]; 

Tf  =2.578;  %  Length  of  simulation 

dt  =0.002;  %  Time  increment  for  simulation 

[phi, del]  =c2d(A,B,dt) ;  %  Discretize  the  system 

kmax  =Tf/dt+l;  %  Maximum  integer  value  for  the  simulation 
y  =zeros(3,kmax) ;  %  Storage  vectors 

d  =zeros(l,kmax); 
u  =zeros(l,kmax) ; 
w  =zeros(l,kmax) ; 
f  =zeros(l,kmax) ; 

2  =zeros( l,kmax) ; 
time  “zeros ( 1 , kmax) ; 

ylO  =  -1/2;  %  Initial  conditions  for  y 

y20  =  0; 
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y(;,l)  =[yl0;y20;y30]; 
%  Switching  Law 
for  (i=l:kniax-l); 


%  Initial  state  vector 


w(i)=sign(y(l,i)+y(2,i)*abs(y(2,i) )/(2*N) ); 
f(i)=y(l,i)+w(i)*(y(2,i)-2)/(2*N)); 
z  (  i  )  =sqrt ( abs ( f ( i ) /N ) ) ; 

u(i)=-N*sign( exp ( -alpha* z(i) )*exp(-w(i)*alpha. . . 
*y(2,i)/N)*(y(3,i)+w(i)*N/alpha)+w(i)*. . . 

( ( -2  *N/alpha )  +  ( exp ( z ( i ) *alpha ) *N/alpha ) ) ) ; 

%  Begin  Simulation 

y(:,i+l)  =phi*y( : ,i)+del*u(i) ; 
d  =C*y(:,i+l); 
time ( i+1 ) =t ime ( i ) +dt ; 
end 

%  Plots  of  The  Outputs 

plot3d(y(l, : ) ,y(2, : ) ,y(3, : ) ,45,45) ; grid; 

%meta  kay3us 

pause;clg;axis( [0  Tf  -1.5  1.5)); 

plot ( time, u, time, 0, 75*w, ' ,tiroe,f , '*' ,time,z) ; 

xlabel ( ' Time  ( sec ) ' ) ; ylabel ( 'Magnitude ' ) ; 

title ('Third  Order  Control  (Uncoupled  Space)'); 

%meta  kay3uc 

axis; 


4.  BB3RD.M 


%  BB3RD.M  11  October  1991 

%  This  program  is  the  simulation  of  the  minimum  time  control 
%  of  the  third  order  regulator  in  uncoupled  space. 

%  written  by  Kayhan  Vardareri 
clg; clear 
alpha  =1; 

N  =1;  %  The  magnitude  of  the  control  effort 

A=[0  1  0;0  1  0;0  0  -alpha];  %State  matrices  of  the  system 
B  =[0;0;l]; 

C  =[1  0  0]; 

Tf  =2.578;  %  Length  of  simulation 

dt  =0.002;  %  Time  increment  for  simulation 

[phi, del]  =c2d(A,B,dt ) ;  %  Discretize  the  system 

kmax  =Tf/dt+l;  %  Maximum  integer  value  for  the  simulation 

X  =zeros(2,kmax) ;  %  Storage  vectors 

y  =zeros ( 1 , kmax) ; 

u  =zeros ( 1 , kmax) ; 

w  =zeros(l,kmax) ; 

f  =zeros ( 1 , kmax) ; 

z  =zeros( l,kmax) ; 

time  =zeros(l,kmax); 

xlO  =-1/2;  %  Initial  conditions  for  y 

x20  =  0; 
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x30  =  0; 

x(:,l)  =[xl0;x20;x30 ] ;  %  Initial  state  vector 

%  Switching  Law 
for  (i=l  :kinax-l) ; 

w(i)=sign(alpha*x(l,i)+x(2,i)+( (alpha*x(2/i)+x(3,i) )*. . . 

abs(alpha*x(2, i)+x( 3, i) )/(2*N) ) ) ; 
f (i)=alpha*x(l,i)+x(2,i)+w(i)*( (alpha*x(2,i)+. . . 

x(3,i))-2)/(2*N)); 
z ( i ) =sqrt ( abs ( f ( i ) /N ) ) ; 

u(i)=-N*sign(exp(-alpha*z(i) )*exp(-w(i)*alpha*( alpha*. . . 
x(2,i)+x(3,i) )/N)*(x(3,i)+w{i)*N/alpha)+w(i)*. . . 

( (exp(alpha*z(i) )*N/alpha)-(2*N/alpha) ) ) ; 

%  Begin  Simulation 

x(:,i+l)  =phi*x( : , i)+del*u(i) ; 
y  =C*x(:,i+l); 
time(i+l )=time(i)+dt; 
end 

%  Plots  of  The  Outputs 

plot3d(x( 1 , :),x(2, ;),x(3, ;),45,45) ;grid; 

%roeta  kay3s 

pause;clg;axis( [0  T£  -1.5  1.5]); 

plot (time, u, time, 0, 7 5*w, ' - . ' ,time, f , ' * ' ,time, z, ; 
xlabel ( ' Time  ( sec ) ' ) ; ylabel ( 'Magnitude ' ) ; 
title ('Third  Order  Control'); 
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%meta  kay3c 
axis 


1 
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